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Abstract 



' The theoretic capacity of a communication system constituted of sev- 

. eral transmitting/receiving elements is determined by the singular values 

' of its transfer matrix. Results based on an independent identically dis- 

tributed channel model, representing an idealized rich propagation envi- 
ronment, state that the capacity is directly proportional to the number of 
antennas. Nevertheless there is growing experimental evidence that the 
capacity gain can at best scale at a sub-linear rate with the system size. 
In this paper, we show under appropriate assumptions on the transfer 
matrix of the system, that the theoretic information-capacity of multi- 
antenna systems is upper bounded by a sub-linear function of the number 
of transmitting/receiving links. 
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1 Introduction 

Some wireless telecommunication systems are made of several antennas working 
simultaneously both at the transmit and the receive link sides. This technology 
named by the acronym MIMO for multiple-input-multiple-output, aims to in- 
crease the capacity of the system, i.e. the throughput of information, expressed 
in bits per second, being transmitted without error for a given frequency band 
width. 

1.1 Capacity 

An exact expression of the capacity of MIMO systems, generalizing the Shannon 
capacity of SISO (for single- input-single -ouput) systems has been derived by G. 
Foschini and M. Gans in [T] when both transmit (Tx) and received (Rx) signals 
are harmonic signals, i.e. signals associated to a fixed frequency. In this case, 
the transmit signal at the j th Tx antenna, j = 1, . . . , N, for N G N*, together 
with the received signal at the i th Rx antenna, i = 1, . . . , M, for M £ N*, are 
simply described by their respective complex amplitudes tj and r^. In presence 
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of noise n = (m, ■ ■ ■ , Rm)' 6 C m , the received signals r = (r l7 . . . , G C m 
are related to the transmit signals t = (tj., . . . , ijy)* £ through the identity 

r = Ht + n, (1) 

where If £ Mm,at(C) is the transfer matrix of the system, and Mjvt,jv(C) denotes 
the set of M-by-N matrices with complex elements. When M — N we write 
Mjv(C) instead of M NtN (C). 

If n is a symmetric Gaussian noise with covariance matrix proportional to 
the identity, i.e. E(rm*) = vqIm f° r some i>q > 0, the Foschini-Gans capacity 
Cm of the system is given by pQ as 

Cm := bg 2 dct (l + ^HH^j , (2) 

where £?s denotes the total power sent by the emitters. Setting n := Es/vq, 
Cm can be expressed in terms of the singular values {ni}fL\ of H as 

M 

C M = E 1 °g 2 ( 1 + ^)- (3) 

Hence the MIMO capacity of the system is the sum of the Shannon capacities 
of M individual SISO channels with respective power gain ;uf , for i = 1, . . . , M 
(see |21I3). 



1.2 Transfer matrix modeling 

The transfer matrix of the system is fully determined by the spatial position 
of the antennas (in the present paper we consider one dimensional uniform 
linear arrays of M = N 6 N* antennas at both transmitter and receiver) and 
the scattering properties of the propagation medium. Unfortunately there is 
no effective method describing the structure of H in a realistic rich scattering 
environment. Moreover there is only a very small number of experimental or 
numerical data of transfer matrices available. For all these reasons several types 
of theoretical models for H have been developed in both the physical and the 
mathematical literatures. 

Based on the spectral theory of random matrices (see e.g. [H [5J [SJ |5]) 
many capacity calculations (see [TJ QUI [HI [HI E3 031 [H]) are carried out 
using a priori probabilistic assumptions on the transfer matrix. Most of these 
probabilistic models ( Q] [HI H21 H31 HI] ) assume that H consists of independent, 
identically distributed Gaussian random variables. These independent fading 
models describe a rich idealized scattering environment whose capacity gain 
turns out to be directly proportional to the number of transmit/receive antenna 
elements. Further, for independent non-identically distributed random entries, 
the results of [5] indicate that the theoretic information capacity remains asymp- 
totically proportional to the number of antennas. Similarly [TUl |TT] show that 
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the correlated fading capacity increases linearly with the number of antennas, 
but less rapidly than in independent fading. 

Another approach is to define H by modeling the scattering characteristics 
of the propagation channels. The corresponding models, based on the geomet- 
rical optics approximation and the derived ray tracing theory, are defined by 
a set of scattering paths V corresponding to scattcrcrs distributed within the 
propagation medium. In these scattering models, the transmitter and receiver 
are coupled via propagation along the path p S V with flT, P and £Ir, p as the 
spatial angles seen by transmitter and receiver, and /3 p (f2ft iP , £lr,p) as the cor- 
responding fading gain. The total gain hij, where hij denotes the element in 
the i th row and j th column of H, for the wavelength of propagation A is defined 
(seee.g. [3[16l[T7l[18j[T9]) as 

= Pp(^R,v,^T, P )e i ^ {nT -''' XT - i) e i ^^' XR ' i \ (4) 

p£V 

xtj and x u,i being the respective positions of the j transmitter and the i th 
receiver. The transfer matrix of the system (jj) is thus directly defined from the 
transmitter and receiver positions together with the physical characteristics of 
the propagation medium. 

1.3 Framework and main result 

In this paper we adopt the scattering model point of view by imposing structure 
on H, based on simulation results obtained with an efficient 3D ray propaga- 
tion model in some reference urban outdoor environment, for one dimensional 
uniform linear arrays of M antennas at both transmit and receive links. More 
precisely, computations of the transfer matrix are carried out for numerous val- 
ues of M g N*, using the (@|-based propagation model GRIMM developed by 
France Telecom (see [201 [3TJ A careful analysis of these data shows that 

the fading matrix F of the system, 

F := M- 2 U M HH*U^ € M M (Q, (5) 

where Um denotes the unitary change of basis matrix from the canonical ba- 
sis of C M to the Fourier basis {^k\t=i^ defined in [TB] as the virtual channel 
representation, 

$ fc := -L;{l,e i ** k t M ,...,e a "( M - 1 W M ) t i k = l,...,M, 

has the two following properties: 

(i) for all i = 1, . . . , M — 1, the off-diagonal terms fkj, j > k > i, of F, are 
small as compared with the diagonal term f^; 

(ii) {fi,i\fLi can be reordered into a decreasing sequence. 
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To avoid the inadequate expense of the size of this article we refer to [33] for both 
the justification and the interpretation of (i)-(ii). These two properties (or, more 
exactly, their corresponding appropriate mathematical statement, formulated as 
assumptions (A1)-(A2) in Section 2) provide useful spectral information on F. 
Namely they enable a precise localization of the eigenvalues of F, involving that 
the capacity Cm of the system is upper bounded by a sub-linear function of the 
system size, M. This is the main result of this paper. 

1.4 Contents 

The paper is organized as follows. In Section 2 we introduce some basic nota- 
tions and auxiliary results, state the assumptions (A1)-(A2) made on the fading 
matrix F, formulate the main results of this paper and briefly comment on them. 
Section 3 contains the proof, based on an appropriate block-decomposition of 
F, of these results. The main technical estimate needed to conclude the proof 
in Section 3 (this estimate actually holds true for any Hermitian matrix inde- 
pendently of the assumptions (Al)-(A2) intrinsic to the model of Section 2) is 
given in Section 3.2. 

2 Capacity scaling 
2.1 Notations and settings 

In this section we introduce some notations used throughout the article and 
recall basic auxiliary estimates needed in the proofs. 

Let A = (o-i,j)i<i,j<n S M n (JC), n > 1, be an Hermitian matrix. We denote 
by Pi (A) the spectral projection of A corresponding to the open interval / cM 
and set 

N(x; A) := rank P (Xt+oo) (A), xeR. 

Otherwise stated N(x; A) denotes the number of eigenvalues of A counted with 
the multiplicities and greater than x. N(.;A) is called the eigenvalue counting 
function of A. 

In the sequel we write a (A) (resp. p(A) := C — cr(Aj) the spectrum (resp. 
resolvent set) of A, and Ad (resp. Ao ■= A — Ad) the diagonal (resp. off- 
diagonal) part of A. 

Further, noting \\A\\ the matrix norm of A associated to the Hermitian norm 
in C", we have (see (1.4.14) and (1.4.16) in [24]) that 

\\A\\ < max n(A), (6) 

. ,71 

where 

Ti (A):= J2 Kil- ( 7 ) 

j=l,...,n 

Finally we recall from the standard perturbation theory (see [24]) that the 
eigenvalues {fJ<i{A)}f =1 of A may be labeled in such a way that the Bauer-Fike's 
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Theorem holds true: 

\lH(A) -a u \ < \\A \\, i= l,...,n. (8) 

2.2 Structure of the fading matrix 

Evidently, the diagonal terms /, := /^j, for i = l,...,Af, of the matrix F 
defined in (|5|) are nonnegative, and we may assume without loss of generality 
that they are arranged in decreasing order: 

0</a/<...</ 2 </i. (9) 

In light of the properties (i)-(ii) mentioned in Section 1.3, we make the two 
following assumptions on the fading matrix F. 

Assumption 1. Our first assumption expresses for each i — 1, . . . ,M — 1, 
that the total weight of the off-diagonal terms fkj, for j > k > i, is bounded, 
up to a multiplicative constant a > 0, by the diagonal element ff 

3a>0,VM>l, ^ f,., ■ ,./,. , 1 \l !. (Al) 

j>k>i 

As proved in Lemma |3. II below, (Al) yields that the (M — zo)-square matrix 

F (lo) : = (hih+iKijKM e M M - io (C), to = 0, . . .,M- 1, (10) 
obtained from F by suppressing its io first rows and columns, satisfies: 

\\F% o) \\<af io+1 , i = 0,...,M-l. (11) 

Assumption 2. Further, we impose that the function i i-> /j decreases suffi- 
ciently fast with j on {1, ... , M}. More precisely we consider a power- like decay 
and require that the power decay rate be greater than one: 

3(/ +)7 )e(0,+oo)x(l,+oc), VAf >1, h<f+i-\ i=l,...,M. (A2) 

Notice for further reference that (A2) entails 

It-C* = 1, — » M s.t. ^ e (a, +oo)} < min (m, /J" 1 ^ -1 ) , a; G (0, oo), (12) 

where US' denotes the cardinality of any subset S of N. 

2.3 Statement of the main results 

By ([5]), the fading matrix F is a nonnegative Hermitian matrix. Thus the 
eigenvalue counting function N(x; F) of F is a non increasing right-continuous 
function of x G M, such that 

N(x; F) =M, x < 0, and N(x; F) = 0, x > p, (13) 

where p := m&Xi=i t ... t M is the spectral radius of F. The first result of this 
paper is a convenient upper bound on N(x;F): 
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Theorem 2.1. Let Mef and F satisfy (Al)-(A2). Then we have 



N(x;F) < min (m,p\ ' x" 1 , ie(0,+oo), (14) 

where 

p+:=(l + a)f + >p. (15) 

As a corollary we obtain under the same conditions that for 7 > 1, the 
Foschini-Gans capacity growths sub-linearly with the system size M: 

Theorem 2.2. Let F be as in Theorem \2.1\ Then the capacity Cm of the 
system is bounded as 

Cm < {KP ^l M^ 1 + ln(l + Kp+M^j , 

the constant p + being defined by H5)) . 

Therefore the capacity Cm growths at most like M 7 InM. For 7 > 1, it 
is thus upper bounded by a sub-linear function of M , at least for M sufficiently 
large. This behavior is different from the one predicted by [lll^ [TOl[TTlfT^l[T51[T4] 
for probabilistic models, where a point-to-point link utilizing M transmitting 
and receiving antennas can achieve a capacity as high as M times that of a 
single-antenna link. Nevertheless it is in accordance with the results of [HI [25] , 
where similar sub-linear capacity scalings are derived for multi-path scattering 
models. Moreover the upper bound given in Theorem 12.21 is corroborated by 
the simulation results obtained in |26] and the experimental evidence of [27] [28] . 
This indicates that the assumptions (A1)-(A2) can be considered a valuable 
alternative to pure probabilistic models, in the study of MIMO-systems theoretic 
capacity. 

2.4 Comments 

In view of Theorems 12 . Ill2~2l we make the three following remarks: 

(i) In this paper, in common with works such as [2[H], but unlike |131 114] . we 
do not assume a normalization which ensures that the total receive power 
is the same as the total transmit power, that is 

M 

Such a normalization condition would imply \\H\\ < M 1 / 2 and hence 
||F|| < M _1 by enabling us to carry out all the computations of 
Section 3 with the constant p+, defined in (fl~6l) . equal to M _1 . Neverthe- 
less it is quite easy to check that this would not significantly change the 
conclusions of Theorems 12.1112.21 
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(ii) As already mentioned in Section 2.2 (see (jlip ). assumption (Al) implies: 

3a>0, VM>1, \\F% o) \\ < afi, i = 1,...,M- 1, (Al') 

the matrix F^, i = 1, ... ,M - 1, being denned in ([ID|). Actually it 
is not hard to check from the proofs of Section 3 that Theorems 12.1112.21 
remain true by substituting the weaker (but less explicit) condition (Al') 
for (Al). 

(iii) Similarly, assumption (A2) is a particular case of the more general condi- 
tion 

J There exists / : [1, +og) — > R + , continuous and decreasing, , . 
\ s.t. VM>1, /i </(*), i = l,...,M, [A2) 



and it is easy to see that Theorem 12. II generalizes to 

N(x; F) < min (M, / _1 ((1 + a)" 1 ^)) , i e (0, +oo), 

where / _1 denotes the inverse function of /, for every F satisfying (Al)- 
(A2') (or (A1')-(A2'), according to point (ii)). 

For instance, if we strengthen (A2) by taking f(x) = /+e _7 ^ -1 ', for some 
(/+>7) £ (0, +oo) 2 , and thus imposing that the diagonal elements of F 
decrease exponentially fast, 

VM> 1, fi^f+e-^-V, i = l,...,M, 

then the capacity of the corresponding system is upper-bounded by a 
polynomial function in In M: 

„ . -r 1 + ln(l + Kp+M) + 7" 1 ln(l + k P+ M) 2 



In 2 

This estimate can be easily obtained by mimicking the proof of Theorem 
12721 



3 Analysis of the capacity 
3.1 Proof of Theorem I27T1 

The proof of Theorem 12. II consists of the two following lemmas. 

Lemma 3.1. Assume (Al). Then for all M <G N* and i = 0, . . . , M — 1, the 

{M — io)-square matrix F^ defined in M0\) satisfies 

\\F% 0) \\ < af i0+1 and ||F^|| < (a+l)/ io+1 . (16) 
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Proof. 

For alH = io + 1) • • • > M, we have 

n(F^)= Y \fu\+ E lAil. 

j=i +l, 1 j=»+l M 

according to ([7]), the first (resp. second) term in the righthand side of (|17l) being 
taken equal to zero if i = io + 1 (resp. ? = M). The matrix i* 1 being Hermitian 
symmetric by ([5]), (jXTJ) becomes 

n{F^)= y E E i/wi. 

j=i +l,...,i-l j=i+l,...,M j>fe>i +l 

whence 

r,(F^ o) ) < a/i +i, i = io + 1, ■ ■ ■ , M. (18) 
from (Al). This combined with (J7J and © yields 

t,(F (io) ) = n(^ io) ) + /< < (a + 1)/. 10+1 , i = i + 1, . . . , M. (19) 

Now the first (resp. second) part of (flu) follows from (J^J) and (|T%|) (resp. ([!]) 
and (HU)). ■ 



Lemma 3.2. Let M be in N*. If the fading matrix F satisfies (Al) then it 
holds true that 

N(x;F)<N((l + a)- 1 x;F D ), 

for all x € [0, +oo). 
Proof. 

For all x G [0, +oo) set n(x) = N((l + ay 1 x;F D ), so that n(x) € {0, 1, . . . ,M}. 
The result being obviously true if n(x) — M, we assume that n(x) < M, which 
entails 

/«(«)+! < ( 2 °) 
Further i* 1 decomposes uniquely into 



A(x) 


C(x) 







where B(x) is the matrix e M M _„ (l) (C) defined by (JIDJ. Since 

|| S (a;) || < a/„ (x ) + i, 

by the first part of (HHJ) in Lemma [3.11 then each eigenvalue f3j, j — n(x) + 
1, . . . , M, of B(x), satisfies 

fi-j < fj + \\B (x)\\ < (1 + a)f n(x)+1 < x, 
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according to ©, © and (|2P)). This yields AT(x; B(x)) = 0, so the result follows 
from the inequality 

N(x;F) < n(x) + N(x;B{x)), (21) 
whose proof is postponed to Section 3.2 below. ■ 

Bearing in mind that 

N(x; F D ) = (t{i = 1, . . . , Af s.t. fi e (s, +oo)}, x € (0, +oo), 
Theorem 12. II follows immediately from this, (fT2"j) and Lemma l3~iZ1 

3.2 Proof of inequality (|2lD 

Inequality (|2"TT) follows from Lemma T3.3I below, which is in turn a consequence 
of a result known as the Cauchy interlacing Theorem (see [29 [Theorem 3(i)]). 

Lemma 3.3. Let ua, Ub be positive integers. Given A = A* 6 M„ A (C), 
B = B* G M„ B (C) and C G M nA> „ B (C), let M be the partitioned (jia + tib) X 
(n^ + ns) matrix defined by 



M := 



A 


c 


C* 


B 



Then we have 

N(x; M) <n A + N(x; B) (22) 

for all real x. 
Proof. 

Given an Hermitian matrix H , and a real number x, let N(x; H) denote the 
number of eigenvalues, counted with multiplicity, less than or equal to x. With 
this notation we obviously have 

N(x; M) + N(x; M) =n A + n B and N(x; B) + N(x; B) = n B , 

for all real x, whence (1221) is equivalent to the inequality 

N(x; B) < N(x; M), x G R. (23) 

Thus it suffices to establish (|2"3"|) . To this purpose the eigenvalues of M are 
written as 

Ai < A2 < . . . < \ nA +n B 
and repeated according to multiplicity. Similarly we write for the eigenvalues 
of B 

Pl<P2< ... <j8ns- 
The Cauchy interlacing Theorem states that we have 

Xj < f3j < X„ A+] , j = 1,2,..., n B . 

Evidently the lefthand inequality yields (f23)) . proving the result. ■ 
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3.3 Proof of Theorem EO 



In light of ©-(O, the Foschini-Gans capacity of the system associated to the 
fading matrix F M can be expressed in terms of the eigenvalues {A,}^ 1 of F, as 

M 

C M = Ys l0 ^ l + KMX i)- ( 24 ) 
i=l 

The remaining part of this section involves relating the capacity Cm to the 
eigenvalue counting function N(.;F) of the matrix F. To this end, we use the 
distributional equality dN(x; F) = — J2i=i ~ ^i) to rewrite as 

C M = f" + log 2 (1 + kMx) (-dN(x; F)). (25) 
Jo 

Integrating by parts in (|25|) and bearing in mind (|13[) . we obtain 

kM f p+ N(xjF) 

whence 

1 p M iV(( K M)- 1 i;F) j 

Cm = — / — dx 

In 2 J 1 + x 

by an obvious change of integration variable. This combined with Theorem 1 2. II 
yields 

(ko^V 1 -i f K P+ M 

If np + M > 1 then the integral domain in the righthand side of (|2"6")l can be 
partitioned into (0,1) and (1, np+M). Since 7 > 1, the integral over (0,1) is 
easily bounded by 7/(7 — 1), while the one over (1, np + M) is majorized by 
ln(l + Kp + M). In the case where np + M < 1 then the integral in the righthand 
side of ([26)) is evidently bounded by 7/(7 — 1). This completes the proof. 

Acknowledgments. The authors are greatly indebted to the anonymous ref- 
eree of this paper for the considerable simplification of their original proof of 
Lemma 13.31 in Section 3.2. 
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